Papers with culturally grounded reasoning
LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models (2026.acl-long)
Copied to clipboard
Jian Gao, Richeng Xuan, Zhaolu Kang, Dingshi Liao, Wenxin Huang, Zongmou Huang, Yangdi Xu, Bowen Qin, Zheqi He, Xi Yang, null Changjinli, Yonghua Lin
| Challenge: | Existing SEA-focused benchmarks miss Lao-specific cultural grounding and linguistic properties. |
| Approach: | They propose a multi-dimensional benchmark for assessing large language models in Lao . they use open-source and held-out subsets to evaluate languages with a hybrid pipeline . |
| Outcome: | LaoBench is the first large-scale, high-quality, and multidimensional benchmark for assessing LLM language understanding and reasoning in Lao. |
Evaluating Cultural Knowledge and Reasoning in LLMs Through Persian Allusions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Allusion recognition is a critical test of LLMs' ability to deploy stored information in open-ended, figurative settings. |
| Approach: | They propose a framework for evaluating Persian literary allusions through annotations and LLM-generated texts incorporating allusion in novel contexts. |
| Outcome: | The proposed framework evaluates Persian literary allusions through annotations and LLM-generated texts incorporating allusion in novel contexts. |